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Many satellite communication systems operating today em- 
ploy low cost upconverters or downconverters which create 
phase noise. This noise can severely limit the information rate 
of the system and pose a serious challenge for the detection 
systems. Moreover, simple solutions for phase noise tracking 
such as PLL either require low phase noise or otherwise 
require many pilot symbols which reduce the effective data 
rate. 

In the last decade we have witnessed a significant amount of 
research done on joint estimation and decoding of phase noise 
and coded information. These algorithms are based on the 
factor graph representation of the joint posterior distribution. 
The framework proposed in [5|, allows the design of efficient 
message passing algorithms which incorporate both the code 
graph and the channel graph. The use of LDPC or Turbo 
decoders, as part of iterative message passing schemes, allows 
the receiver to operate in low SNR regions while requiring 
less pilot symbols. 

In this paper we propose a multiple hypotheses algorithm for 
joint detection and estimation of coded information in a strong 
phase noise channel. We also present a low complexity mixture 
reduction procedure which maintains very good accuracy for 
the belief propagation messages. 

I. System Model 

We consider the transmission of a sequence of complex 
modulation symbols c = (co, Ci, crt-i) over an AWGN 
channel affected by carrier phase noise. We assume the sym- 
bols are drawn independency from an MPSK constellation. 
The discrete-time baseband complex equivalent channel model 
at the receiver is given by: 

r k = c k eJ 9k +n k k = 0, 1, K - 1. (1) 

The phase noise stochastic model is a wiener process: 

9k = Qk-i + Afc (2) 

where A k is a real, i.i.d gaussian sequence with A k ~ 
N(0,al). 

The factor graph representation of the joint posterior distri- 
bution was given in [1| and is shown in Fig. [T] 
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Fig. 1. Factor graph representation of the joint posterior distribution 

The resulting Sum & Product messages are: 
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Where M,r k ,Pd, a 2 and ^(OjCr^,^) are the constellation 
order, received base band signal, symbol soft information from 
LDPC decoder, AWGN variance and Gaussian distribution 
respectively. 



Due to the fact that the phase symbols are continuous 
random variables, a direct implementation of these equations 
is not possible and approximations are unavoidable. In |4|, a 
modified Tikhonov approximation is used for the messages in 
the SPA which leads to a very simple and fast algorithm. 

The best known message passing algorithm for phase noise 
channels quantizes the phase noise and performs an approxi- 
mation of the sum & product algorithm (SPA). This algorithm 
(called DP - discrete phase in this paper) requires large 
computational resources to reach high accuracy, rendering it 
not practical for some real world applications. In this paper, 
an approximate inference algorithm is proposed which better 
balances the tradeoff between accuracy and complexity for 
strong phase noise channels. 

II. Multiple Hypotheses Canonical Model 

We propose to approximate the SPA messages using the 
following Tikhonov mixtures, 
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And, a{ ,a\,z{ ,z\ are the mixture coefficients and Tikhonov 
parameters of the forward and backward messages of the phase 
symbol 9k-i and 0fc+i respectively. N is the model order for 
both messages. 

If we insert approximations (|9]l and ( fT0| i in to the forward 
and backward recursion equations Q respectively, we get 
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(14) 

The resulting Tikhonov mixtures will be of order NM. 
Therefore, a mixture reduction algorithm must be derived 
which captures "most" of the information in the mixtures ( 13 1 



and (14 1, while keeping the computational complexity low. 

We define the following mixture reduction task using the 
Kullback Leibler divergence - Given a Tikhonov mixture f{9) 
of order L, find a Tikhonov mixture g(6) of order N (L > N), 
which minimizes, 
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This divergence detailed in Q, is a very popular measure 
of "closeness" of the reduced mixture to the original mixture. 
Unfortunately, the task of finding the mixture, g(9) which 



minimizes ( 16 1 is NP hard. There are many suboptimal mixture 
reduction algorithms which work on the principle of sequen- 
tially merging mixture components until the target mixture size 
is reached. A very good summary of many of these algorithm 
can be found in [2|. 

A. Canonical Model - Adaptive Mixture Size 

Instead of reducing the mixture to a fixed size N, we pro- 
pose a new approach which has better accuracy while keeping 
low complexity. Since we are performing bayesian inference 
on a large data block, we have many mixture reductions 
to perform (one for each symbol), rather than just a single 
reduction. Therefore, in terms of computational complexity, it 
is useful to use different mixture sizes for different symbols 
and look at the average number of components as a measure 
of complexity. We have shown that this new observation is 
critical in achieving high accuracy and low PER. 

B. Mixture Reduction Algorithm 

In this section, a mixture reduction algorithm will be 
proposed which receives as input 
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Where, fi(6) are Tikhonov distributions. 

And outputs a reduced order Tikhonov mixture, 
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Where, gt(0) are Tikhonov distributions and N < L. 

The details of the algorithm are given in pseudo-code in 
Algorithm 1. This algorithm uses the Circular Mean and 
Variance Matching (CMVM) approach, detailed in f4], for 
optimally merging a Tikhonov mixture to a single Tikhonov 
distribution. Moreover, the function \f(6) \ outputs the number 
of Tikhonov components in the Tikhonov mixture f(9). 

The output Tikhonov mixture g{9) is a reduced version 
of f(9) and approximates the next forward and backward 
messages. 

The choice of the threshold [i in the algorithm, is according 
to the level of distortion allowed for the reduced mixture with 



Algorithm 1 Mixture Reduction Algorithm 

while j < L or |/(0)| > do 
lead <— argmaxk{alphak} 
idx <— lead 
for i= 1 |/(6i)| do 

if l>jr£(/i(0)||yw(0)) <Mthen 

idee ■<— [idee, i] 
end if 
end for 

g 3 {9) <- CMVM(a(idx),f(idx)) 
j3j <— Y^, ot{idx) 

Normalize f(0) 

j <- j + 1 
end while 



respect to the original mixture. If (i is very close to zero, 
then there won't be any components close enough and the 
mixture will not be reduced. Therefore, there is a tradeoff 
between complexity and accuracy in the selection of this 
parameter. Moreover, this parameter is not sensitive to SNR, 
phase noise variance or other scenario parameters which make 
this algorithm very robust. 

We define N (maximum allowable mixture order) to be 
very large (w 20). In the simulations performed in this paper, 
the average number of components was much lower than the 
maximum allowed. 

C. Average Number of Mixture Components 

Using monte carlo simulations, we show that the average 
number of components in the canonical model, denoted in this 
paper as 7 is reasonably small compared to the constellation 
order. This size depends mainly on the number of ambiguities 
the phase estimation algorithm suffers between pilots. These 
ambiguities are a function of the SNR, phase noise variance 
and algorithmic design parameters such as the number of 
LDPC iteration and the threshold p. 

The proposed algorithm shows, very small average number 
of mixture components per block symbol, thus keeping a 
reasonable computational complexity load. 

D. Complexity 

The complexity is summarized in table 1, where the com- 
putational load for DP and the algorithm proposed in this 
paper are compared. The computational complexity for DP 
was taken from [1|. We assume that all non-linear operations 
are implemented using look up tables. The complexity analysis 
was done assuming that the number of components in the 
canonical model is the average number of mixture components 
per iteration i - 7(1), which is measured using simulations. It is 
important to note that 7(1), the average number of hypotheses 
in iteration i, decreases as the iterations increases. This is 
due to the fact that the LDPC decoder provides better soft 




Eb/No, dB 

Fig. 2. Packet error rate - QPSK and wiener phase noise 

information on the symbols thus resolving ambiguities and 
decreasing the required number of components in the mixture. 

TABLE I 

Computational load per code symbol per iteration for M-PSK 

CONSTELLATION 





DP 


Multi Hyp Algo 


Operations 


13ML + WQL -9L- 3M 


Af7(i)(ll + 57(i)) + M 


LUT 


3ML + 2QL - 3L - M 


M 7 (i)(6 + 7(i)) 



Let L be the number of quantization levels and Q is a 
parameter for the DP algorithm explained in (TJ. 

We can see that we can achieve a high level of accuracy 
while maintaining a low computational load. Therefore, the 
algorithm proposed in this paper provides an improved tradeoff 
between accuracy and complexity. 

III. Numerical Results 

Monte Carlo simulation results for the algorithm are shown 
in Fig. [2] A length 4608 LDPC code with rate 0.75 was 
used, where the coded bits were mapped to an QPSK con- 
stellation. The phase noise model used was a wiener process 
with <7a = 0.1[rads/symbol]. A single pilot was inserted 
every 60 symbols. It should be noted that without pilots, the 
proposed algorithm can work as well as DP. The DP algorithm 
was simulated using 8 quantization levels. The parameter fi 
was adjusted empirically to achieve a good accuracy and 
complexity tradeoff. 

As shown in Fig |2j the proposed algorithm provides very 
good packet error rate in high phase noise level and very close 
to the performance of the optimal algorithm even when very 
few pilots are present and the code rate is high. The algorithm 
proposed in (TJ, denoted BARB in the figure was added 
for comparison. It can be shown that the proposed multiple 
hypotheses algorithm performs much better than BARB, which 
is considered state of the art. 
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Fig. 3. Average Mixture Order per Symbol 

Moreover, in Fig. [3] we present the average number of 
mixture components in the canonical model for different SNR 
and LDPC iterations. It can be seen that for the first iteration, 
there is a need to have many components because there is 
a high level of phase ambiguity and in order to maintain 
accuracy the mixture order is greater than 1 (3.5 components 
per received symbol). As the iterations progress the LDPC 
decoder sends better soft information for the code symbols, 
resolving these ambiguities. Therefore, the average number of 
mixture components becomes closer to 1. In Fig. [4] we show 
the distribution of the mixture order in the canonical model for 
different iterations for SNR = 4.5dB. In this SNR, the packet 
error rate of the algorithm is around 10~ 3 , so the distribution 
of the number of components is of real operational interest, 
since it creates an upper bound on the physical memory 
required to store the components. It can be seen, for this 
scenario, that the mixture order never exceeds 7 components. 

In table 2, we show the computational complexity of the 
proposed algorithm in comparison to the DP algorithm. It 
should be noted that the computational complexity of the mul- 
tiple hypotheses algorithm varies between LDPC iterations, 
thus reducing the overall complexity, while the computational 
complexity of the DP algorithm remains constant. 

TABLE II 

Simulation Results - Computational load per code symbol per 
iteration for m-psk constellation 





DP 


Multi Hyp, iteration 1 


Multi Hyp, iteration 2 


Operations 


2324 


403 


115 


LUT 


476 


133 


45 



IV. Conclusions 

In this paper an algorithm for joint detection and estimation 
of LDPC in strong phase noise channels was presented. The 
proposed algorithm is based on the approximation of SPA 
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Fig. 4. Distribution of Mixture Order - SNR = 4.5dB 

messages using Tikhonov mixture canonical models. The prob- 
lem of exponential increase in mixture size was solved using 
a new approach for mixture dimension reduction proposed 
in this contribution. This approach significantly reduced the 
computational complexity while keeping PER levels very close 
to the optimal algorithm (DP). The dimension reduction also 
uses newly reported results in directional statistics for optimal 
clustering of Tikhonov mixtures. 
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